Test Data Result Obj Size Not Ignored
Result
Model Summaries
| Model | Best Models on Exp. | Better than base % of the times |
|---|---|---|
| LR_1_spec | 15 | 11.4286 |
| LR_1_All | 21 | 1.42857 |
| LR_1_log_spec | 7 | 18.5714 |
| LR_1_log_All | 1 | 11.4286 |
| LR_1_mean_spec | 19 | 20 |
| LR_1_mean_All | 6 | 10 |
| LR_2_spec | 19 | 10 |
| LR_2_All | 21 | 5.71429 |
| LR_2_log_spec | 15 | 10 |
| LR_2_log_All | 2 | 4.28571 |
| LR_2_mean_spec | 24 | 18.5714 |
| LR_2_mean_All | 2 | 5.71429 |
| LR_v5_spec | 2 | 5.71429 |
| LR_v5_All | 1 | 5.71429 |
| LR_v6_spec | 1 | 5.71429 |
| LR_v6_All | 1 | 5.71429 |
| little_random_forest_spec | 0 | 31.4286 |
| logistic_regression_spec | 1 | 2.85714 |
| logistic_regression_All | 1 | 5.71429 |
| logistic_regression_v2_spec | 3 | 5.71429 |
| logistic_regression_v2_All | 17 | 57.1429 |
| logistic_regression_v3_spec | 7 | 37.1429 |
| logistic_regression_v3_All | 0 | 11.4286 |
| logistic_regression_v4_spec | 3 | 31.4286 |
| logistic_regression_v4_All | 0 | 20 |
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 94.3179 | 0 | 30.262 | 5.40057 |
| LR_1_All | 92.4203 | -0.0814759 | 12.9991 | 0 |
| LR_1_log_spec | 98.9612 | 0 | 27.6345 | 7.47617 |
| LR_1_log_All | 90.1819 | 2.57692 | 48.1988 | 52.9958 |
| LR_1_mean_spec | 95.4221 | 0 | 23.8771 | 0.310631 |
| LR_1_mean_All | 100 | 0.139368 | 58.6845 | 71.5815 |
| LR_2_spec | 91.9293 | 0 | 25.5744 | 0 |
| LR_2_All | 89.5874 | -0.213279 | 12.8441 | 0 |
| LR_2_log_spec | 95.1937 | 0 | 27.6454 | 0.382983 |
| LR_2_log_All | 86.4176 | 5.32411 | 55.1869 | 59.7461 |
| LR_2_mean_spec | 97.0183 | 0 | 26.7121 | 0.0154206 |
| LR_2_mean_All | 100 | 0.737111 | 62.7988 | 69.2948 |
| LR_v5_spec | 100 | 3.77238e-06 | 80.0283 | 100 |
| LR_v5_All | 100 | 99.9999 | 100 | 100 |
| LR_v6_spec | 100 | 97.5623 | 99.9181 | 99.9998 |
| LR_v6_All | 100 | 97.5623 | 99.9181 | 99.9999 |
| little_random_forest_spec | 100 | 0.200996 | 64.2481 | 69.1575 |
| logistic_regression_spec | 100 | 0 | 77.8765 | 100 |
| logistic_regression_All | 100 | 100 | 100 | 100 |
| logistic_regression_v2_spec | 100 | -0.0784616 | 28.6944 | 0.707168 |
| logistic_regression_v2_All | 56.9735 | 0.707168 | 18.2832 | 10.5607 |
| logistic_regression_v3_spec | 100 | 0.314614 | 70.0288 | 78.5025 |
| logistic_regression_v3_All | 99.2122 | 50.6748 | 90.487 | 95.0255 |
| logistic_regression_v4_spec | 97.4116 | 19.7775 | 70.6744 | 74.8239 |
| logistic_regression_v4_All | 96.3797 | 21.9626 | 74.5052 | 83.1461 |
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 0.963094 | -38.2969 | -4.13373 | -0.000127885 |
| LR_1_All | 0.151154 | -46.9848 | -3.08542 | 0 |
| LR_1_log_spec | 1.68774 | -29.6923 | -2.34982 | -0.00175551 |
| LR_1_log_All | 2.30797 | -17.2854 | -4.07722 | -1.53221 |
| LR_1_mean_spec | 2.49751 | -45.0214 | -3.23355 | 0 |
| LR_1_mean_All | 2.0323 | -83.8301 | -15.1569 | -3.82646 |
| LR_2_spec | 1.71643 | -38.6581 | -3.57087 | 0 |
| LR_2_All | 1.43849 | -29.5364 | -2.15527 | 0 |
| LR_2_log_spec | 2.21177 | -43.0321 | -3.7943 | 0 |
| LR_2_log_All | 2.20056 | -27.9052 | -7.34634 | -6.32235 |
| LR_2_mean_spec | 2.60271 | -48.4051 | -3.95344 | 0 |
| LR_2_mean_All | 1.92882 | -79.7733 | -15.2699 | -5.40369 |
| LR_v5_spec | 2.60943 | -67.5129 | -16.0921 | -15.4302 |
| LR_v5_All | 2.60943 | -67.5129 | -16.9064 | -15.4302 |
| LR_v6_spec | 2.60943 | -67.5122 | -16.903 | -15.4302 |
| LR_v6_All | 2.60943 | -67.5122 | -16.9031 | -15.4302 |
| little_random_forest_spec | 3.7867 | -16.4085 | -3.40806 | -1.80289 |
| logistic_regression_spec | 1.51335 | -64.3863 | -11.9804 | -3.56557 |
| logistic_regression_All | 2.60943 | -67.5129 | -16.9064 | -15.4302 |
| logistic_regression_v2_spec | 0.113034 | -10.6636 | -1.64422 | -0.122698 |
| logistic_regression_v2_All | 4.23077 | -8.84895 | 0.603377 | 0.290047 |
| logistic_regression_v3_spec | 23.839 | -31.9559 | -3.05555 | -1.49142 |
| logistic_regression_v3_All | 2.70394 | -50.5816 | -12.5506 | -11.4997 |
| logistic_regression_v4_spec | 9.62847 | -25.409 | -4.87457 | -2.8789 |
| logistic_regression_v4_All | 2.80681 | -29.7517 | -6.84265 | -6.14585 |
Model Summaries Plot
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
True Negatives (%)
True Positives (%)
False Negatives (%)
False Positives (%)
Individual Workload Result
10
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/alibabaBlock/v2/10.oracleGeneral.zst
0.001
Best Models: LR_1_All,LR_2_spec,LR_2_All,LR_2_mean_spec,LR_v5_spec
Miss Ratio: 0.999568
0.01
Best Models: LR_v5_spec,LR_v5_All,LR_v6_spec,LR_v6_All,logistic_regression_spec,logistic_regression_All
Miss Ratio: 0.890473
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.0346106
0.2
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0342232
0.4
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.0336914
Object Size Ignored
2016_LUN6
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/systor/2016_LUN6.oracleGeneral.zst
0.001
Best Models: LR_2_All
Miss Ratio: 0.830015
0.01
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.699474
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.383723
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.198792
0.4
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.143264
Object Size Ignored
202206_kv_traces_all.csv
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaKV/202206_kv_traces_all.csv.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.211619
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.100321
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0499373
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0411439
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0338314
Object Size Ignored
8610
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/tencentBlock/v2/traces/8610.oracleGeneral.zst
0.001
Best Models: LR_1_spec
Miss Ratio: 0.9037
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.79176
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.176032
0.2
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0491772
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.00992362
Object Size Ignored
cluster53
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/twitter/cluster53.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.636095
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.313188
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.108301
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0763369
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0537166
Object Size Ignored
meta_rprn
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaCDN/meta_rprn.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.586703
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.520473
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.429722
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.389006
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.346304
Object Size Ignored
wiki_2019u
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/wiki/wiki_2019u.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.6071
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.290395
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0668907
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.0386781
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0239131
Object Size Ignored
zipf_0.3
0.001
Best Models: LR_1_mean_All
Miss Ratio: 0.998778
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.987792
0.1
Best Models: LR_1_mean_All
Miss Ratio: 0.879949
0.2
Best Models: LR_1_mean_All
Miss Ratio: 0.765574
0.4
Best Models: LR_1_mean_All
Miss Ratio: 0.552575
Object Size Ignored
zipf_0.7
0.001
Best Models: LR_1_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec
Miss Ratio: 0.961411
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.872851
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.632252
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.499366
0.4
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.321945
Object Size Ignored
zipf_0
0.001
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_log_All,LR_1_mean_spec,LR_1_mean_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_log_All,LR_2_mean_spec,LR_2_mean_All
Miss Ratio: 0.998997
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.990002
0.1
Best Models: LR_2_mean_All
Miss Ratio: 0.900068
0.2
Best Models: LR_2_log_All
Miss Ratio: 0.800221
0.4
Best Models: LR_1_mean_spec
Miss Ratio: 0.600966
Object Size Ignored
zipf_1.3
0.001
Best Models: LR_1_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.145437
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All
Miss Ratio: 0.0645036
0.1
Best Models: LR_1_All,LR_2_All,LR_2_mean_spec
Miss Ratio: 0.0239022
0.2
Best Models: LR_1_All,LR_2_spec,LR_2_mean_spec
Miss Ratio: 0.0163646
0.4
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.0105821
Object Size Ignored
zipf_1.7
0.001
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.0520027
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0103631
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00205443
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00128691
0.4
Best Models: LR_2_mean_spec
Miss Ratio: 0.00085926
Object Size Ignored
zipf_1
0.001
Best Models: LR_2_mean_spec
Miss Ratio: 0.586253
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.405233
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.213886
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.152787
0.4
Best Models: LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0897345
Object Size Ignored
zipf_2
0.001
Best Models: LR_2_mean_spec
Miss Ratio: 0.0677587
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00656036
0.1
Best Models: LR_1_All,LR_1_mean_spec,LR_2_All,LR_2_mean_spec
Miss Ratio: 0.00065771
0.2
Best Models: LR_1_All,LR_2_spec,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00034185
0.4
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.00019375
Object Size Ignored
Test Data Result Obj Size Ignored
Result
Model Summaries
| Model | Best Models on Exp. | Better than base % of the times |
|---|---|---|
| LR_1_spec | 19 | 14.2857 |
| LR_1_All | 29 | 5.71429 |
| LR_1_log_spec | 11 | 15.7143 |
| LR_1_log_All | 1 | 7.14286 |
| LR_1_mean_spec | 11 | 14.2857 |
| LR_1_mean_All | 7 | 10 |
| LR_2_spec | 21 | 8.57143 |
| LR_2_All | 25 | 7.24638 |
| LR_2_log_spec | 13 | 2.85714 |
| LR_2_log_All | 3 | 4.28571 |
| LR_2_mean_spec | 13 | 4.28571 |
| LR_2_mean_All | 3 | 5.71429 |
| LR_v5_spec | 4 | 5.71429 |
| LR_v5_All | 1 | 5.71429 |
| LR_v6_spec | 1 | 5.71429 |
| LR_v6_All | 1 | 5.71429 |
| little_random_forest_spec | 0 | 8.57143 |
| logistic_regression_spec | 2 | 14.2857 |
| logistic_regression_All | 4 | 11.4286 |
| logistic_regression_v2_spec | 6 | 11.4286 |
| logistic_regression_v2_All | 10 | 5.71429 |
| logistic_regression_v3_spec | 0 | 8.57143 |
| logistic_regression_v3_All | 0 | 2.85714 |
| logistic_regression_v4_spec | 3 | 5.71429 |
| logistic_regression_v4_All | 0 | 11.4286 |
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 92.0446 | 0 | 32.7461 | 10.5128 |
| LR_1_All | 91.9917 | -1.06327 | 14.4885 | 0 |
| LR_1_log_spec | 100 | -1.12488 | 32.8915 | 15.5722 |
| LR_1_log_All | 90.6117 | 3.97207 | 48.3129 | 52.9563 |
| LR_1_mean_spec | 97.3788 | -1.12488 | 36.6896 | 11.0929 |
| LR_1_mean_All | 99.9988 | -0.872275 | 58.8501 | 81.6335 |
| LR_2_spec | 90.931 | 0 | 27.1572 | 0 |
| LR_2_All | 88.8918 | -1.08096 | 16.0244 | 0 |
| LR_2_log_spec | 95.7198 | 0 | 34.0425 | 12.8883 |
| LR_2_log_All | 84.3947 | 5.1315 | 53.7967 | 59.2451 |
| LR_2_mean_spec | 97.8264 | 0 | 37.0855 | 12.0563 |
| LR_2_mean_All | 99.9956 | 0.804119 | 61.8432 | 79.2326 |
| LR_v5_spec | 100 | 6.78421e-06 | 80.0002 | 100 |
| LR_v5_All | 100 | 100 | 100 | 100 |
| LR_v6_spec | 100 | 97.7969 | 99.9305 | 99.9999 |
| LR_v6_All | 100 | 97.7968 | 99.9304 | 99.9999 |
| little_random_forest_spec | 98.4318 | 15.6201 | 65.9544 | 74.0006 |
| logistic_regression_spec | 100 | 0 | 73.5277 | 86.7793 |
| logistic_regression_All | 99.9965 | 0 | 59.1499 | 68.9119 |
| logistic_regression_v2_spec | 100 | 0 | 42.788 | 25.96 |
| logistic_regression_v2_All | 99.8691 | -6.6907e-06 | 46.267 | 50.0287 |
| logistic_regression_v3_spec | 99.9781 | 0 | 75.9921 | 85.43 |
| logistic_regression_v3_All | 99.2417 | 39.3788 | 90.4969 | 94.528 |
| logistic_regression_v4_spec | 94.894 | 0 | 57.4264 | 68.9322 |
| logistic_regression_v4_All | 93.5123 | 14.7999 | 66.0359 | 73.8614 |
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 0.814411 | -28.9246 | -3.41595 | -0.0103247 |
| LR_1_All | 1.73908 | -31.2671 | -2.07613 | 0 |
| LR_1_log_spec | 1.67397 | -27.121 | -2.47744 | -0.0347169 |
| LR_1_log_All | 2.90327 | -17.9166 | -4.0107 | -1.77686 |
| LR_1_mean_spec | 0.370884 | -34.2553 | -5.0524 | -0.798484 |
| LR_1_mean_All | 0.411127 | -101.391 | -15.6041 | -4.35833 |
| LR_2_spec | 3.27644 | -27.2999 | -2.68145 | 0 |
| LR_2_All | 3.9955 | -27.1992 | -2.05873 | 0 |
| LR_2_log_spec | 0.522617 | -29.7012 | -3.66113 | -0.350655 |
| LR_2_log_All | 1.37734 | -27.8001 | -6.96888 | -5.78625 |
| LR_2_mean_spec | 0.420901 | -34.7739 | -4.98049 | -0.476007 |
| LR_2_mean_All | 0.0194047 | -90.674 | -15.7937 | -6.73837 |
| LR_v5_spec | 0.179718 | -67.5507 | -15.5198 | -12.0956 |
| LR_v5_All | 0.179718 | -67.5507 | -16.3988 | -12.0958 |
| LR_v6_spec | 0.179718 | -67.5507 | -16.3965 | -12.0956 |
| LR_v6_All | 0.179718 | -67.5507 | -16.3965 | -12.0956 |
| little_random_forest_spec | 0.787593 | -15.0014 | -3.60195 | -1.97334 |
| logistic_regression_spec | 7.43423 | -27.1145 | -6.21537 | -2.83513 |
| logistic_regression_All | 4.96142 | -57.0391 | -10.3355 | -1.54011 |
| logistic_regression_v2_spec | 3.23472 | -16.5131 | -2.03106 | -0.674374 |
| logistic_regression_v2_All | 0.955959 | -50.9477 | -5.64218 | 0 |
| logistic_regression_v3_spec | 2.74147 | -24.9863 | -6.43694 | -2.76207 |
| logistic_regression_v3_All | 0.00140759 | -44.6993 | -12.9765 | -9.23276 |
| logistic_regression_v4_spec | 2.95571 | -25.7473 | -5.19023 | -2.38206 |
| logistic_regression_v4_All | 0.666145 | -24.4697 | -5.60997 | -2.23389 |
Model Summaries Plot
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
True Negatives (%)
True Positives (%)
False Negatives (%)
False Positives (%)
Individual Workload Result
10
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/alibabaBlock/v2/10.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_spec,LR_2_All,LR_v5_spec
Miss Ratio: 0.999575
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.994365
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.062645
0.2
Best Models: LR_v5_spec,LR_v5_All,LR_v6_spec,LR_v6_All
Miss Ratio: 0.0342699
0.4
Best Models: LR_1_log_spec
Miss Ratio: 0.034033
2016_LUN6
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/systor/2016_LUN6.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,LR_v5_spec,logistic_regression_All
Miss Ratio: 0.836408
0.01
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.733029
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.403522
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.214693
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.147587
202206_kv_traces_all.csv
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaKV/202206_kv_traces_all.csv.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.242686
0.01
Best Models: LR_1_log_spec,LR_1_mean_spec
Miss Ratio: 0.115557
0.1
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0552932
0.2
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0451591
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0351843
8610
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/tencentBlock/v2/traces/8610.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.89831
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.763691
0.1
Best Models: LR_1_log_spec
Miss Ratio: 0.164029
0.2
Best Models: LR_1_mean_spec
Miss Ratio: 0.0521634
0.4
Best Models: logistic_regression_spec
Miss Ratio: 0.0126432
cluster53
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/twitter/cluster53.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_log_spec
Miss Ratio: 0.456887
0.01
Best Models: LR_1_log_spec
Miss Ratio: 0.1583
0.1
Best Models: logistic_regression_All
Miss Ratio: 0.056228
0.2
Best Models: logistic_regression_spec
Miss Ratio: 0.0403833
0.4
Best Models: LR_2_log_All
Miss Ratio: 0.0326154
meta_rprn
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaCDN/meta_rprn.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,logistic_regression_All
Miss Ratio: 0.59364
0.01
Best Models: LR_1_All,LR_2_All,logistic_regression_v4_spec
Miss Ratio: 0.527533
0.1
Best Models: LR_1_All,logistic_regression_v2_All
Miss Ratio: 0.437969
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.394803
0.4
Best Models: LR_2_spec
Miss Ratio: 0.353883
wiki_2019u
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/wiki/wiki_2019u.oracleGeneral.zst
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,LR_v5_spec,logistic_regression_All
Miss Ratio: 0.728852
0.01
Best Models: LR_1_All,LR_2_All,logistic_regression_v4_spec
Miss Ratio: 0.458307
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.117294
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0595329
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0295192
zipf_0.3
Object Size Ignored
0.001
Best Models: LR_1_mean_All
Miss Ratio: 0.998778
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.9878
0.1
Best Models: LR_1_mean_All
Miss Ratio: 0.880255
0.2
Best Models: LR_1_mean_All
Miss Ratio: 0.766415
0.4
Best Models: LR_1_mean_All
Miss Ratio: 0.553504
zipf_0.7
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.961405
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.872851
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.632252
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.499366
0.4
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.321945
zipf_0
Object Size Ignored
0.001
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_log_All,LR_1_mean_spec,LR_1_mean_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_log_All,LR_2_mean_spec,LR_2_mean_All
Miss Ratio: 0.998997
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.990002
0.1
Best Models: LR_2_mean_All
Miss Ratio: 0.900066
0.2
Best Models: LR_2_log_All
Miss Ratio: 0.800227
0.4
Best Models: LR_2_mean_All
Miss Ratio: 0.600963
zipf_1.3
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.145431
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All
Miss Ratio: 0.0645036
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.0239022
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.0163646
0.4
Best Models: LR_2_spec
Miss Ratio: 0.0105821
zipf_1.7
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.0519973
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec
Miss Ratio: 0.0103631
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00205443
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00128691
0.4
Best Models: LR_2_spec
Miss Ratio: 0.00085926
zipf_1
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.586254
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.405233
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.213886
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.152787
0.4
Best Models: LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0897345
zipf_2
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.0677552
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00656036
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00065771
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00034185
0.4
Best Models: LR_2_mean_spec
Miss Ratio: 0.00019374
Test Data Result Combined
Result
Model Summaries
| Model | Best Models on Exp. | Better than base % of the times |
|---|---|---|
| LR_1_spec | 34 | 12.8571 |
| LR_1_All | 50 | 3.57143 |
| LR_1_log_spec | 18 | 17.1429 |
| LR_1_log_All | 2 | 9.28571 |
| LR_1_mean_spec | 30 | 17.1429 |
| LR_1_mean_All | 13 | 10 |
| LR_2_spec | 40 | 9.28571 |
| LR_2_All | 46 | 6.47482 |
| LR_2_log_spec | 28 | 6.42857 |
| LR_2_log_All | 5 | 4.28571 |
| LR_2_mean_spec | 37 | 11.4286 |
| LR_2_mean_All | 5 | 5.71429 |
| LR_v5_spec | 6 | 5.71429 |
| LR_v5_All | 2 | 5.71429 |
| LR_v6_spec | 2 | 5.71429 |
| LR_v6_All | 2 | 5.71429 |
| little_random_forest_spec | 0 | 20 |
| logistic_regression_spec | 3 | 8.57143 |
| logistic_regression_All | 5 | 8.57143 |
| logistic_regression_v2_spec | 9 | 8.57143 |
| logistic_regression_v2_All | 27 | 31.4286 |
| logistic_regression_v3_spec | 7 | 22.8571 |
| logistic_regression_v3_All | 0 | 7.14286 |
| logistic_regression_v4_spec | 6 | 18.5714 |
| logistic_regression_v4_All | 0 | 15.7143 |
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 94.3179 | 0 | 31.5041 | 5.98883 |
| LR_1_All | 92.4203 | -1.06327 | 13.7438 | 0 |
| LR_1_log_spec | 100 | -1.12488 | 30.263 | 11.009 |
| LR_1_log_All | 90.6117 | 2.57692 | 48.2558 | 52.9958 |
| LR_1_mean_spec | 97.3788 | -1.12488 | 30.2833 | 2.63595 |
| LR_1_mean_All | 100 | -0.872275 | 58.7673 | 72.406 |
| LR_2_spec | 91.9293 | 0 | 26.3658 | 0 |
| LR_2_All | 89.5874 | -1.08096 | 14.4228 | 0 |
| LR_2_log_spec | 95.7198 | 0 | 30.8439 | 5.16365 |
| LR_2_log_All | 86.4176 | 5.1315 | 54.4918 | 59.2451 |
| LR_2_mean_spec | 97.8264 | 0 | 31.8988 | 0.289551 |
| LR_2_mean_All | 100 | 0.737111 | 62.321 | 71.947 |
| LR_v5_spec | 100 | 3.77238e-06 | 80.0142 | 100 |
| LR_v5_All | 100 | 99.9999 | 100 | 100 |
| LR_v6_spec | 100 | 97.5623 | 99.9243 | 99.9999 |
| LR_v6_All | 100 | 97.5623 | 99.9243 | 99.9999 |
| little_random_forest_spec | 100 | 0.200996 | 65.1012 | 72.4465 |
| logistic_regression_spec | 100 | 0 | 75.7021 | 99.9867 |
| logistic_regression_All | 100 | 0 | 79.575 | 99.9982 |
| logistic_regression_v2_spec | 100 | -0.0784616 | 35.7412 | 6.30771 |
| logistic_regression_v2_All | 99.8691 | -6.6907e-06 | 32.2751 | 13.8486 |
| logistic_regression_v3_spec | 100 | 0 | 73.0104 | 85.4181 |
| logistic_regression_v3_All | 99.2417 | 39.3788 | 90.4919 | 94.8823 |
| logistic_regression_v4_spec | 97.4116 | 0 | 64.0504 | 70.5971 |
| logistic_regression_v4_All | 96.3797 | 14.7999 | 70.2706 | 76.9763 |
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
| Model | Max | Min | Avg | Mdn |
|---|---|---|---|---|
| LR_1_spec | 0.963094 | -38.2969 | -3.77484 | -0.00479191 |
| LR_1_All | 1.73908 | -46.9848 | -2.58077 | 0 |
| LR_1_log_spec | 1.68774 | -29.6923 | -2.41363 | -0.00931561 |
| LR_1_log_All | 2.90327 | -17.9166 | -4.04396 | -1.73808 |
| LR_1_mean_spec | 2.49751 | -45.0214 | -4.14297 | -0.000351399 |
| LR_1_mean_All | 2.0323 | -101.391 | -15.3805 | -4.08282 |
| LR_2_spec | 3.27644 | -38.6581 | -3.12616 | 0 |
| LR_2_All | 3.9955 | -29.5364 | -2.10735 | 0 |
| LR_2_log_spec | 2.21177 | -43.0321 | -3.72772 | -5.00213e-05 |
| LR_2_log_All | 2.20056 | -27.9052 | -7.15761 | -6.12637 |
| LR_2_mean_spec | 2.60271 | -48.4051 | -4.46696 | 0 |
| LR_2_mean_All | 1.92882 | -90.674 | -15.5318 | -6.17077 |
| LR_v5_spec | 2.60943 | -67.5507 | -15.8059 | -12.1399 |
| LR_v5_All | 2.60943 | -67.5507 | -16.6526 | -12.1861 |
| LR_v6_spec | 2.60943 | -67.5507 | -16.6497 | -12.186 |
| LR_v6_All | 2.60943 | -67.5507 | -16.6498 | -12.186 |
| little_random_forest_spec | 3.7867 | -16.4085 | -3.505 | -1.88811 |
| logistic_regression_spec | 7.43423 | -64.3863 | -9.09787 | -3.20035 |
| logistic_regression_All | 4.96142 | -67.5129 | -13.6209 | -3.37766 |
| logistic_regression_v2_spec | 3.23472 | -16.5131 | -1.83764 | -0.161767 |
| logistic_regression_v2_All | 4.23077 | -50.9477 | -2.5194 | 0 |
| logistic_regression_v3_spec | 23.839 | -31.9559 | -4.74624 | -2.55056 |
| logistic_regression_v3_All | 2.70394 | -50.5816 | -12.7636 | -10.0336 |
| logistic_regression_v4_spec | 9.62847 | -25.7473 | -5.0324 | -2.44283 |
| logistic_regression_v4_All | 2.80681 | -29.7517 | -6.22631 | -4.20272 |
Model Summaries Plot
Miss Ratio Reduced (%)
\(\dfrac{Base Miss Ratio - Model Miss Ratio}{Base Miss Ratio} \times 100\)
Promotion Reduced (%)
\(\dfrac{Base Promotion - Model Promotion}{Base Promotion} \times 100\)
True Negatives (%)
True Positives (%)
False Negatives (%)
False Positives (%)
Individual Workload Result
10
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/alibabaBlock/v2/10.oracleGeneral.zst
0.001
Best Models: LR_1_All,LR_2_spec,LR_2_All,LR_2_mean_spec,LR_v5_spec
Miss Ratio: 0.999568
0.01
Best Models: LR_v5_spec,LR_v5_All,LR_v6_spec,LR_v6_All,logistic_regression_spec,logistic_regression_All
Miss Ratio: 0.890473
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.0346106
0.2
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0342232
0.4
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.0336914
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_spec,LR_2_All,LR_v5_spec
Miss Ratio: 0.999575
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.994365
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.062645
0.2
Best Models: LR_v5_spec,LR_v5_All,LR_v6_spec,LR_v6_All
Miss Ratio: 0.0342699
0.4
Best Models: LR_1_log_spec
Miss Ratio: 0.034033
2016_LUN6
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/systor/2016_LUN6.oracleGeneral.zst
0.001
Best Models: LR_2_All
Miss Ratio: 0.830015
0.01
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.699474
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.383723
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.198792
0.4
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.143264
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,LR_v5_spec,logistic_regression_All
Miss Ratio: 0.836408
0.01
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.733029
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.403522
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.214693
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.147587
202206_kv_traces_all.csv
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaKV/202206_kv_traces_all.csv.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.211619
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.100321
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0499373
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0411439
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0338314
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.242686
0.01
Best Models: LR_1_log_spec,LR_1_mean_spec
Miss Ratio: 0.115557
0.1
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0552932
0.2
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0451591
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0351843
8610
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/tencentBlock/v2/traces/8610.oracleGeneral.zst
0.001
Best Models: LR_1_spec
Miss Ratio: 0.9037
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.79176
0.1
Best Models: logistic_regression_v4_spec
Miss Ratio: 0.176032
0.2
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0491772
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.00992362
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.89831
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.763691
0.1
Best Models: LR_1_log_spec
Miss Ratio: 0.164029
0.2
Best Models: LR_1_mean_spec
Miss Ratio: 0.0521634
0.4
Best Models: logistic_regression_spec
Miss Ratio: 0.0126432
cluster53
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/twitter/cluster53.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.636095
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.313188
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.108301
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0763369
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0537166
Object Size Ignored
0.001
Best Models: LR_1_log_spec
Miss Ratio: 0.456887
0.01
Best Models: LR_1_log_spec
Miss Ratio: 0.1583
0.1
Best Models: logistic_regression_All
Miss Ratio: 0.056228
0.2
Best Models: logistic_regression_spec
Miss Ratio: 0.0403833
0.4
Best Models: LR_2_log_All
Miss Ratio: 0.0326154
meta_rprn
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/metaCDN/meta_rprn.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.586703
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.520473
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.429722
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.389006
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.346304
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,logistic_regression_All
Miss Ratio: 0.59364
0.01
Best Models: LR_1_All,LR_2_All,logistic_regression_v4_spec
Miss Ratio: 0.527533
0.1
Best Models: LR_1_All,logistic_regression_v2_All
Miss Ratio: 0.437969
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.394803
0.4
Best Models: LR_2_spec
Miss Ratio: 0.353883
wiki_2019u
https://ftp.pdl.cmu.edu/pub/datasets/twemcacheWorkload/cacheDatasets/wiki/wiki_2019u.oracleGeneral.zst
0.001
Best Models: logistic_regression_v2_All
Miss Ratio: 0.6071
0.01
Best Models: logistic_regression_v2_All
Miss Ratio: 0.290395
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0668907
0.2
Best Models: logistic_regression_v2_spec
Miss Ratio: 0.0386781
0.4
Best Models: logistic_regression_v3_spec
Miss Ratio: 0.0239131
Object Size Ignored
0.001
Best Models: LR_1_All,LR_2_All,LR_v5_spec,logistic_regression_All
Miss Ratio: 0.728852
0.01
Best Models: LR_1_All,LR_2_All,logistic_regression_v4_spec
Miss Ratio: 0.458307
0.1
Best Models: logistic_regression_v2_All
Miss Ratio: 0.117294
0.2
Best Models: logistic_regression_v2_All
Miss Ratio: 0.0595329
0.4
Best Models: logistic_regression_v2_spec,logistic_regression_v2_All
Miss Ratio: 0.0295192
zipf_0.3
0.001
Best Models: LR_1_mean_All
Miss Ratio: 0.998778
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.987792
0.1
Best Models: LR_1_mean_All
Miss Ratio: 0.879949
0.2
Best Models: LR_1_mean_All
Miss Ratio: 0.765574
0.4
Best Models: LR_1_mean_All
Miss Ratio: 0.552575
Object Size Ignored
0.001
Best Models: LR_1_mean_All
Miss Ratio: 0.998778
0.01
Best Models: LR_1_mean_All
Miss Ratio: 0.9878
0.1
Best Models: LR_1_mean_All
Miss Ratio: 0.880255
0.2
Best Models: LR_1_mean_All
Miss Ratio: 0.766415
0.4
Best Models: LR_1_mean_All
Miss Ratio: 0.553504
zipf_0.7
0.001
Best Models: LR_1_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec
Miss Ratio: 0.961411
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.872851
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.632252
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.499366
0.4
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.321945
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.961405
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.872851
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.632252
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.499366
0.4
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.321945
zipf_0
0.001
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_log_All,LR_1_mean_spec,LR_1_mean_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_log_All,LR_2_mean_spec,LR_2_mean_All
Miss Ratio: 0.998997
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.990002
0.1
Best Models: LR_2_mean_All
Miss Ratio: 0.900068
0.2
Best Models: LR_2_log_All
Miss Ratio: 0.800221
0.4
Best Models: LR_1_mean_spec
Miss Ratio: 0.600966
Object Size Ignored
0.001
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_log_All,LR_1_mean_spec,LR_1_mean_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_log_All,LR_2_mean_spec,LR_2_mean_All
Miss Ratio: 0.998997
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.990002
0.1
Best Models: LR_2_mean_All
Miss Ratio: 0.900066
0.2
Best Models: LR_2_log_All
Miss Ratio: 0.800227
0.4
Best Models: LR_2_mean_All
Miss Ratio: 0.600963
zipf_1.3
0.001
Best Models: LR_1_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.145437
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All
Miss Ratio: 0.0645036
0.1
Best Models: LR_1_All,LR_2_All,LR_2_mean_spec
Miss Ratio: 0.0239022
0.2
Best Models: LR_1_All,LR_2_spec,LR_2_mean_spec
Miss Ratio: 0.0163646
0.4
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.0105821
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.145431
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All
Miss Ratio: 0.0645036
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.0239022
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.0163646
0.4
Best Models: LR_2_spec
Miss Ratio: 0.0105821
zipf_1.7
0.001
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.0520027
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0103631
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00205443
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00128691
0.4
Best Models: LR_2_mean_spec
Miss Ratio: 0.00085926
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.0519973
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec
Miss Ratio: 0.0103631
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00205443
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00128691
0.4
Best Models: LR_2_spec
Miss Ratio: 0.00085926
zipf_1
0.001
Best Models: LR_2_mean_spec
Miss Ratio: 0.586253
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.405233
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.213886
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.152787
0.4
Best Models: LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0897345
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.586254
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.405233
0.1
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.213886
0.2
Best Models: LR_1_spec,LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.152787
0.4
Best Models: LR_1_All,LR_1_log_spec,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.0897345
zipf_2
0.001
Best Models: LR_2_mean_spec
Miss Ratio: 0.0677587
0.01
Best Models: LR_1_spec,LR_1_All,LR_1_mean_spec,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00656036
0.1
Best Models: LR_1_All,LR_1_mean_spec,LR_2_All,LR_2_mean_spec
Miss Ratio: 0.00065771
0.2
Best Models: LR_1_All,LR_2_spec,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00034185
0.4
Best Models: LR_1_mean_spec,LR_2_mean_spec
Miss Ratio: 0.00019375
Object Size Ignored
0.001
Best Models: LR_1_spec
Miss Ratio: 0.0677552
0.01
Best Models: LR_1_spec,LR_1_All,LR_2_spec,LR_2_All,LR_2_log_spec,LR_2_mean_spec
Miss Ratio: 0.00656036
0.1
Best Models: LR_1_All,LR_2_All
Miss Ratio: 0.00065771
0.2
Best Models: LR_1_All,LR_2_spec
Miss Ratio: 0.00034185
0.4
Best Models: LR_2_mean_spec
Miss Ratio: 0.00019374